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Scaling Laws for Disturbance Propagation in 
Cyclic Dynamical Networks 

Milad Siami and Nader Motee 


Abstract 

Our goal is to analyze performance of stable linear dynamical networks subject to external stochastic 
disturbances. The square of the 'H2-iiorm of the network is used as a performance measure to quantify 
the expected steady-state dispersion of the outputs of the network. We show that this performance 
measure can be tightly bounded from below and above by some spectral functions of the state-space 
matrices of the network. This result is applied to a class of cyclic linear networks and shown that their 
performance measure scale quadratically with the network size. 
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I. Introduction 

The class of dynamical networks with eyelie intereonneetion topologies has been the foeus of 
numerous studies over the past few years. Examples of dynamieal networks with eyelie struetures 
inelude gene regulation networks [HI, metabolie pathways ll2|-[|5l, and eellular signaling pathways 
lO. The results of this paper have been motivated by eyelie dynamieal networks arising in 
biologieal networks. In [HI, the authors propose a sufficient stability condition for an unperturbed 
eyelie network. Later on, these results were extended to show that global asymptotie stability 
eonditions for eyelie dynamieal networks ean be obtained using diagonal stability and passivity 
properties of subsystems in the form of some seeant eonditions 0 . Although, stability properties 
of eyelie linear and nonlinear dynamieal networks have been studied in several reeent works, 
a eomprehensive performance analysis is yet to be done for this class of networks. In various 
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applications such cyclic dynamical networks must operate in uneertain environments sueh as 
under influenee of external stoehastie disturbanees. Therefore, one of the relevant ehallenges is 
to study performanee of eyelie dynamieal networks under external stoehastie disturbanees. 

In this paper, we first present a result on performanee analysis of general stable linear systems 
subjeet to external stoehastie disturbanees. We employe the square of the 'H 2 -norm of the system 
from disturbanee input to the output as a performanee measure [O, dUl. We derive explieit tight 
lower and upper bounds for this performanee measure that are speetral funetions of the state- 
spaee matriees of the system. Then, this general result is utilized to quantify inherent fundamental 
limits on the performanee measure of a elass of eyelie linear dynamieal networks. This elass of 
eyelie networks with asymmetrie struetures has been used to model eertain bioehemieal pathways 
|31-|0. We partieularly show that the performanee measure of a eyelie linear dynamieal network 
seales quadratieally with the network size. Moreover, it is shown that when all subsystems are 
identieal, the network attains the best aehievable performanee among all eyelie networks with 
the same seeant eriterion. 

The notation used in this paper is fairly standard. Speeifieally, M denotes the set of real 
numbers, C denotes the set of eomplex numbers, Re{.} denotes the real part of a eomplex 
number, (.)^ denotes transpose and (.)^ denotes Hermitian transpose. Iny.n £ is the identity 
matrix, 0„ G is a veetor of all zeros. For a square matrix A, Tr( 2 l) refers to the summation 
of on-diagonal elements of A. We write Xmax{M) (resp., Amin(Af)) for the maximum (resp., 
minimum) eigenvalue of the matrix M, diag[z;] for a square diagonal matrix with the elements 
of veetor v and ||.||2 for 2-norm of a veetor. The eigenvalues of a symmetrie matrix Q G 
are indexed in aseending order Ai((5) < A 2 (Q) < ■ ■ ■ < A„(Q). E[r)] stands for the expeeted 
value of random variable v. 


II. Problem Formulation 

The steady-state varianee of outputs of linear systems driven by external stoehastie disturbanees 
ean be regarded as a measure of performanee. We eonsider a linear time-invariant system 


Ax + 

(1) 

Cx, 

(2) 
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with a:(0) = 0„, where x G M" is the state and y G the output of the system. The input 
signal G M” is a white noise proeess with zero mean and identity eovarianee, i.e., 

= InxnS{t-r), (3) 

where (5(.) is the delta funetion. It is assumed that the state matrix A is Hurwitz. 

Definition 1: The 'H 2 -norm of linear system ©-© from to ?/ is defined as the square root 
of the following quantity 

Pss(^;<5) := lim E , (4) 

t^oo 

where Q = C^C. 

For unstable linear systems, the outputs of the system have finite steady state varianee as 
along as the unstable modes of the system are not observable from the output of the system (ef. 
lISl). The value of performanee measure @ for ean be quantified as 

pMQ) = Tr(P), (5) 

where P is the unique solution of the Lyapunov equation 

PA + A^P + Q = 0. (6) 

Our first goal is to ealeulate tight lower and upper bounds on the performanee measure (HI) 
for general stable linear time-invariant systems. Our seeond goal is to utilize these bounds to 
eharaeterize size-dependent fundamental limits on the performanee measure of eyelie linear 
dynamieal networks. 


III. The Main Result 


Sinee the performanee measure dH) is real-valued, we show that this measure ean be sand- 
wiehed between two real-valued funetions of eigenvalues of matriees A and Q. 

Theorem 1: In linear system ([B-©, suppose that the disturbanee input is a white stoehastie 
proeess ^ with zero-mean and eovarianee ©, the state matrix A is Hurwitz, and Q = C^C. 
Then, we have 


^minjQ) C n ( A 

^2Re{Aj(/l)} - 


(7) 
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where As = is the systematic part of matrix A and Hurwitz. Moreover, the lower bound in 
([7]) is achieved if and only if A is normal, i.e., A^A = AA^, and Q has n identical eigenvalues. 

Proof: Every symmetric matrix Q can be decomposed as Q = UDU^ where UU'^ = U^U = 
I and D = diag [Ai((5), • • ■ A„(Q)]. Using this fact, we can rewrite db]) in the following form 

A^P + PA + D = 0, ( 8 ) 


where A = U^AU and P = U^PU. Since A is Hurwitz, all its eigenvalues have strictly negative 
real parts. Therefore, the unique solution of dS]) can be expressed in the following closed form 

(9) 

According to Schur decomposition theorem ifTOll . there exists a unitary matrix V E such 

that A = V{T + N)V^ where T = diag [Ai(A), • • • , A„(A)], N is strictly upper triangular, and 
is the conjugate transpose of V. Next, let us consider the integrand of dH) 



Tr(e^"*De^*) 


Tr(e^”*U)e^*) 






( 10 ) 


Furthermore, we have 

g(r+JV)t ^ 

g(rH+ivH)t ^ + (12) 

where Mt is an upper-triangular Nilpotent matrix. From (fTTl) and dl2l), we have 

Tr(e(^”+^")*e(^+^)*) = + M,Mf) 

> Tr(e(^“+^)*). (13) 
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From (fTOl) and (fT3]) . it follows that 




> A„in(Q)Tr(e(r"+r)*) 
= A„in(g)Tr(e2^"{r>*). 


( 14 ) 


Since Re{Aj(A)} 7^ 0 for alH = 1,..., n, from dH) and (fT4l) we have 


Tr(F) = Tr(P) 


/ 


0 





(15) 


In the last inequality, we apply the faet that the traee and sum operators are linear and they 
ean eommute with the integral. Note that the lower bound is aehieved if and only if equalities 
in (fT4l) and (fTSl) hold, or equivalently, when Q has n identieal eigenvalues and A is a normal 
matrix, i.e., A^A = AA^. In order to prove the RHS inequality in (|7]), we use [fTTl Corollary 


2.1.1], whieh gives us the upper bound in (|7|). 


Remark 1: If Q = qinxn for 9 > 0, then the lower bound in Theorem [T] is tighter than the 
lower bounds reported in referenee papers [[T^ - lfTSll . 

The following corollary explores one speeial case and shows how the performanee measure 
dH) depends on the general properties of A. 

Corollary 1: Suppose that the assumptions of Theorem [T] hold. Furthermore, if we assume that 
matrix A is normal and matrix Q has n identieal eigenvalues, i.e., A((5) = Aj(Q) = ... = A„(Q), 
then 



(16) 


where Ag = is the systematie part of matrix A. 


Proof: Aeeording to the Schur deeomposition for normal matrices, there exists a unitary 


V E sueh that A = VTV^ where F = diag{Ai(v4),... (A), A„(A)} and denotes the 
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Tfe fft k. 


Fig. 1: Schematic diagram of negative feedback noisy cyclic system. The dashed link indicates a negative 
(inhibitory) feedback signal. 


conjugate transpose of matrix V. Using this we have 


A. = 


= V 


r + r« 




= Udiag(Re{Ai(A)},..., Re{A„(yl)})U«. 


(17) 


This implies that Aj(v45) = Re{Ai(y4)} for alH = 1,..., n. Thus, the lower and upper bounds 
in ([7]) eoineide and therefore, we get equality (fT^ . ■ 

All symmetrie, skew-symmetrie, and orthogonal matriees are examples of normal matriees. 
Aeeording to Corollary [U when A is normal, the performanee measure (01) ean be exaetly equal 
to the upper bound and ealeulated as a funetion of eigenvalues of the symmetrie part of A. This 
should be differentiated from the result of Theorem [U where it is shown that the lower bound 
is attained if and only if A is normal and all eigenvalues of Q are identieal. 


IV. Cyclic Linear Dynamical Networks 

We apply our main result to a nontrivial and interesting elass of linear systems with eyclic 
intereonneetion topologies. An example of a eyelie network is an autoeatalytie pathway in biology 
with ring topology, whieh consists of a sequence of bioehemieal reaetions where the system’s 
produet (output) is neeessary to power and eatalyze its own funetion lIT^ . ifTTll . We eonsider 
a eyelie linear dynamieal network eonsists of a group of linear-time invariant systems St with 
state-space representations 

“f T ^2; 

(18) 

Vi CiXi^ 
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for z = 1,... ,n, where a* and c* are strietly positive eonstants. The sealar quantities Ui,Vi,Xi 
are the input, output and state variables of subsystem Si, respeetively. By eonsidering series 
intereonneetion of subsystems iSj for z = 1,2, • • • , n and applying the output of subsystem z as 
the input of subsystem z + 1 (see Fig. [T]), we ean represent the dynamies of the overall eyelie 
network as follows 


Af: 


= -aiXi -Vn + Ci, 

X2 = -a2X2 + Vi+^2, 

T ^n—1 “F ^ni 


\ 


(19) 


where for z = 1,2, • • • ,rz are independent white stoehastie proeesses with identieal statisties. 
The resulting dynamieal system takes the eanonieal eompaet form ©-dH) with state matrix 


—oi 0 
Cl —0,2 


A = 


0 0 
0 0 


0 Cfi 

0 0 

^n—1 0 

Cn—1 


( 20 ) 


and output matrix C = Inxn- Our goal is to investigate robustness properties of the eyelie linear 
dynamieal network (fT9l) driven by external white stoehastie disturbanees. 

Theorem 2: For the eyelie linear dynamieal network (fT9l) driven by a zero-mean white stoehas¬ 
tie proeess with eovarianee ®, let us define 


0 ;= ^0102 • • - an, 

C := (/CiC2 ■ - -Cn- 


If 7 > cos(^) where 7 = then the eyelie linear dynamieal network is stable. Moreover, if we 
assume that a = oi = ■ • • = a„, then 


Pss (^) Inxri) ^ 


n ^ 

2 Re{A,(/l)} 
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( 21 ) 


n tan ^ 


7 < 1 


2c sin ■£ 




n' 


7=1 


4c 



where 


/): 


arcos( 7 )n , 7 < 1 
arcosh( 7 )n , 7 > 1 


( 22 ) 


The equality in (l2TI) is aehieved if and only if ci = ... = Cn, whieh means that all subsystems 
iSj for i = 1 ,..., n are identieal. 

Proof: The stability condition 7 > cos(^) implies that A is Hurwitz. Therefore, the 912- 
norm squared is finite and given by Tr(P) (see flUl for more details), where P is the unique 
positive definite solution of the Lyapunov equation 


AP + P A^ — — Inxn- 


(23) 


When a = oi = 02 = • • • = On, it is straightforward to verify that the characteristic equation of 
A is given by 

(A + u)” + C1C2 ■ ■ ■ Cn = 0. 

Therefore, the eigenvalues of the matrix are 



for = - ,n — 1. By substituting these eigenvalues into the lower bound of ([7]), we get 



n 


n—1 



n—1 


(24) 
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First, let us assume that 7 < 1 and substitute 7 = cos(^) in (l24l) . It follows that 


-E 


2Re{Ai(v4)} 2c ^ cos(^) 


-l n—1 

-E 

9r 


n—1 


_^csc(^^^ + |^)csc( 


A:=0 


ntan ■ 
2c sin 


1 


cos(- + 

^ n 


(2/cH-l)7r 

2n 


2'Kk \ 
n ' 


2n 


) 


where the Birkhoff Ergodie theorem is used to eonelude the last equation. Similar steps ean be 
taken when 7 > 1. In eaeh ease by substituting 7 from (l22l) in (l24l) . one ean obtain the desired 
result in the RHS of (|2T]) . Aeeording to Theorem [U the equality in (|2TI) is aehieved if and only 
if A is a normal matrix. On the other hand, based on the eyelie strueture of matrix (l20l) and the 
faet that oi = ... = a^, we eonelude that A is normal if and only if ci = ... = c^. ■ 

The elassieal seeant eriterion reported in [|71| and [[T]| for eyelie linear dynamieal network (fT9l) 
provides a stability eondition when all Oj for i = 1,... , n are identieal. This eondition implies 
that the unperturbed system with ^ = 0 in (fT9l) is stable if and only if 7 > cos(^). For a fixed 
parameter (3, the stability eondition of the eyelie network is not affeeted when the number of 
intermediate subsystems ehanges. However, the result of Theorem [^asserts that the lower bound 
of the performanee measure dH) inereases when the network size inereases. We show that the 
performanee measure dH) is in order of when parameter /5 is fixed Q. More explieitly, we 


*We employ the big omega notation in order to generalize the concept of asymptotic lower bound in the same way as O 
generalizes the concept of asymptotic upper bound. We adopt the following definition according to 1181 : 

/(n) = il{g{n)) g{n) = 0{f{n)), (25) 

where O represents the big O notation. In the left hand side of l l25t . the fl notation implies that /(n) grows at least of the 
order of g{n). 
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obtain the following approximation 





(26) 



According to this calculation, we conclude that 'H 2 -norm of the cyclic network scales with Q{n). 

Remark 2: In Theorem [2l it is shown that performance measure of network (fT9l) is always 
greater or equal to the right hand-side of (|2T]) . When network Af consists of n identical sub¬ 
systems, i.e. a := Oi = ... = a„ and c ;= Ci = ... = c„, the performance measure attains its 
minimum value among all networks with the same parameters a and c. Furthermore, its value 
is given by the RHS of (l2T]) . 

In the following corollary, we analyze the performance of a cyclic network when the output 
of the network only depends on the state of the last subsystem, Xi (see Figure [I])- 

Corollary 2: Suppose that the following condition holds for the cyclic linear dynamical 
network (fT9l) 



a 


(27) 


> 


c 


where a := ai = ... = a„, c := ci = ... = c„, and the output of the system is defined by 


y = Cx 


0 ... 0 1 X. 


(28) 


Then, the steady-state output dispersion is bounded from above by 


Pss Q) ■= lim 


1 


2 (o-ccos(^))' 


(29) 


Proof: The steady-state output dispersion is given by 


p,,(A;Q) = Tr{CPC^), 
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where P is the unique solution of the Lyapunov equation 


AP + P + Inxn — 0 - 


(30) 


Aeeording to Theorem [2l our assumption (l27l) implies that all the eigenvalues of A have strietly 
negative real parts. Therefore, the unique solution of (l30l) ean be written in the following elosed 
form 

POO 

P= (31) 

Jo 

The state matrix defined by (l20l) is normal, i.e., A^A = AA^. Aeeording to the speetral theorem, 
there exists a unitary matrix V G sueh that A = VAV^, where A = diag [Ai(A), • • • , An(A)]. 
We now eonsider the integrand of (ISTl) 


P = 






= V diag 


2Re{Ai(A)}’ ’2Re{A„(A)} 


Sinee ||C ||2 = 1, it follows that 


Tr(CPC'^) < maxAi(P) 


V 


H 


= max 


2Re{Ai(A)} 

1 


(32) 


2(a- ccos(^))' 

Furthermore, the result of this eorollary ean be also eonsidered as a direet eonsequenee of 
Theorem [B Sinee aeeording to (l28l) matrix Q has only one nonzero eigenvalue, An(Q) = 1, and 
the maximum eigenvalue of Ag is given by 




A„(As) = a-ccos(-), 


n 


therefore, the desired result is obtained by using (|7]). 
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The result of Corollary is interesting as it implies that the performance measure scales by 
0{n^), when parameter /? is fixed. This follows from rewriting the RHS of inequality (|29|) in 
the following form 

1 _ 1 
2(a-ccos(^)) “ 4csin(^)sin(^)’ 

where 7 < 1 , similar argument can be used where 7 > 1 . 

V. Simulations 

In order to verify our theoretical results, we consider cyclic network (fT9l) with n identical 
subsystems Si for i = 1,... ,n. The asymptotic scaling of 'H 2 -norm for this network is depicted 
in terms of the total network size and parameter (3 in Figure [2l In this case, since subsystems are 
identical, the 'H 2 -norm of cyclic network (fT9l) can be calculated by the square root of the RHS 
of (l2TI) . These values are depicted by small red circles (o) versus the number of subsystems {n). 
Moreover, these values are compared asymptotically to their approximation given by the square 
root of (|2^ . It can be observed that the square root of (|2^ tightly approximates the 'H 2 -noxm 
of cyclic network (fT9l) . Based on Theorem [2l even when subsystems S'j’s are not identical, we 
can say that Figure [2] portrays the lower bounds on the 7 ^ 2 -norm of cyclic network (fT9l) . This 
implies that 'H 2 -norm of the cyclic network scales with VL{n) as long as parameter (3 is fixed. 

VI. Conclusion 

In this paper, we have considered performance analysis of stable linear dynamical networks 
subject to external stochastic disturbances. We deployed the square of the 'H 2 -norm of the system 
from disturbance input to the output as a performance measure. Explicit formulae are derived 
for lower and upper bounds on the performance measure of the network. Then, we applied this 
result to an important class of cyclic linear networks and demonstrated that their performance 
measure scale quadratically with the network size. Finally, it is shown that when all subsystems 
are identical, the network attains the best achievable performance among all cyclic networks 
with the same secant criterion. 
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